DI Results

Load and stress tests were performed for Data Intake v12.2 in a load-balanced environment with a 4-JVM cluster.

The enrollment processing flow included the following actions: beginLoading, addRecord, complete, and endProcess.

Results:

  • 50,000 records were processed in 13 minutes.

  • 100,000 records were processed in 42 minutes.

For reference, the observed throughput was approximately:

  • 64 records/sec for the 50,000-record run.

  • 40 records/sec for the 100,000-record run.

Specs

 Environment

DI Properties

4 cycle instance running with DI

 

dataIntake.period=10

 

dataIntake.reProcessingLimit = 10

 

dataIntake.yieldTimePeriod = 1000

 

dataIntake.recordGroupSize = 50

 

dataIntake.gridCapacity = 5000

 

dataIntake.addRecordCorePoolSize = 150

 

dataIntake.corePoolSize=150

Memory

6 GB heap

DB connection pool size

#

Data Source Name

Parameters

1

ADMINSERVERDS

ADMINSERVERSEARCHDS

ADMINSERVERRESOURCEDS

ADMINSERVERREADONLYDS

maxActive = 300

maxIdle = 50

minIdle = 10

initialSize = 20

maxWait = 10000

Results

DI Results for Enrollment on 12.2

Record count

Total Time

50,000 +00 00:13:28.122000
100,000 +00 00:42:07.068000

Note: Above mentioned Properties are suggested purely based on Transaction configuration, List of SQLs involved and hardware specifications. And it can vary depending on configuration/Dump size and hardware specifications.

DB CPU Utilization

Application CPU Utilization

DB Memory Utilization

Application Memory Utilization